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An analysis is made of the degree of precision required in a 
digitally implemented adaptive equalizer to achieve a satisfactory 
level of performance. Considering both the conventional synchro- 
nously spaced equalizer and the newer fractionally spaced equalizer, 
insight is provided into the relationship between the tap- weight 
precision and the steady-state, mean-squared error. It is demon- 
strated why the number of adaptive tap weights should be kept to a 
minimum (consistent with acceptable steady-state performance), both 
from convergence and precision requirements. A simple formula is 
given that displays the tradeoff among the equalizer mean-squared 
error, the number of taps, the channel characteristics, and digital 
resolution. For typical basic- conditioned voiceband channels oper- 
ating at 9.6 kb/s, and neglecting the effects that limited resolution 
might have on timing and carrier phase tracking, analysis and 
simulation both indicate that the required tap- weight resolution is of 
the order of 11 or 12 bits. Moreover, the minimum precision is only 
weakly dependent on the quality of the channel. 

I. INTRODUCTION 

State-of-the art adaptive equalizers for voiceband modems are digi- 
tally implemented and strive to minimize the equalized mean-squared 
error. ' An important consideration in assessing the complexity of such 
an adaptive digital equalizer is the number of bits required to represent 
the stored signal samples and the equalizer tap weights. Gitlin, Mazo, 
and Taylor 2 have shown that the precision required for successful 
adaptive operation, via the estimated-gradient algorithm, 3 can be 
significantly greater than that required for static or fixed equalization. 
The purpose of this paper is to determine the precision required in the 
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tap-updating circuitry so that the equalizer mean-squared error can 
attain an acceptable level. 

In the well-known estimated-gradient tap adjustment algorithm, 3 
the tap weights are incremented by a term proportional to the product 
of the instantaneous output error and the voltage stored in the corre- 
sponding delay element. When this correction term is less than half a 
tap-weight quantization interval, the algorithm ceases to make any 
further substantive adjustment. To determine the minimum number 
of bits needed to achieve an acceptable performance level (mean- 
squared error), an appropriate proportionality constant, or step size, 
must be determined for use in the algorithm. From pure analog, or 
infinite precision considerations, a relatively large step size is desirable 
to accelerate initial convergence, 2 " 5 while a small step size is needed to 
reduce the residual mean-squared error (that part of the error in excess 
of the minimum attainable mean-squared error). If the channel is 
stationary, then in the converged mode the analog algorithm should 
use a vanishingly small step size to provide almost no fluctuation about 
the minimum obtainable mean-squared error. However, in a digitally 
implemented algorithm, a decrease in the step size can actually degrade 
performance unless there is a compensating increase in the precision 
of the tap weights. This occurs when the error is so small that an 
increased number of bits are needed in order that the proportionately 
smaller corrections be "seen" by the equalizer. 

A useful compromise is to choose a step size that provides a slight 
increase in the steady-state mean-squared error to a level which can 
be attained by a digital equalizer of reasonable precision. This pre- 
cludes the choice of an unrealistically small step size — with its concom- 
itant requirement of excessive precision — and provides a mechanism 
for the analytical determination of the necessary level of precision. Our 
objective, then, is to be able to directly calculate the precision required 
to achieve an acceptable performance level. 

In Section II, assuming parameters with infinite precision, we deter- 
mine the step size which produces a specified increase in the mean- 
squared error. This result is combined in Section III with digital 
considerations to determine the precision required in the equalizer 
coefficients. Simulation results are presented in Section IV to illustrate 
our results for both the conventional synchronous and the newer 
fractionally spaced equalizers. 
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II. ANALOG CONSIDERATIONS 

In this section, we review the basic equalized data communications 
system in an analog, or infinite precision, environment and determine 
the steady-state step size associated with a fractional increase in the 
residual mean-squared error above the minimum attainable error. 
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2. 1 System model 

For simplicity, we consider the baseband-equivalent data transmis- 
sion system of Fig. 1 with received samples 

r(nT) A r„ = X OmXinT - mT) +v(nT ), (1) 

m 

where {a m } are the discrete-valued data symbols, x(-) is the pulse 
shape at the receiver input, {i»(nT')} are independent noise samples, 
1/T is the symbol rate, and 1/T' is the receiver sampling rate. For the 
conventional synchronous equalizer, T' = T, while for fractionally 
spaced equalizers 6,7 (fses), 1/T' will exceed twice the highest frequency 
component in x(t). The equalizer output is computed only 
every T seconds and is given by 



N 



u(nT)= X c m r(nT-mT), 

m — N 



(2) 



where the equalizer has (2N + 1) tap weights. The standard perform- 
ance measure is the mean-squared error (mse) at the equalizer output, 

r- ((u(nT) - a n ) 2 ) = «c'r„ - a„) 2 >, (3) 

where ( • ) denotes the ensemble average, c and r„ are, respectively, 
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Fig. 1— (a) Simplified baseband-equivalent pam data transmission system, (b) Tapped 
delay line equalizer. 
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the vector of equalizer tap weights and the vector of samples stored in 
the equalizer at the nth output sampling instant, and the prime 
denotes vector transpose. Carrying out the indicated expectation in (3) 
for binary-valued independent data symbols gives 

% = c'Ac - 2c' x + 1, (4) 

where A = (r n r' n ) is the channel correlation matrix and x = (a n r n ) is 
the truncated channel-sample vector; minimizing % with respect to the 
tap weights gives the familiar optimum quantities: 1_2 

Copt = A -1 x (5) 

gf p t = 1 - x'A-'x. (6) 

2.2 Estimated-gradient algorithm 

A well-known, and frequently implemented, algorithm for the iter- 
ative adaptive determination of the optimal tap weights is 

Cn+M = c„ - A„e n r„, n = 0, M, 2M, • • • , (7) 

where e n = u n — a„ is the error signal,* A„ is the step size, and c h +m is 
the vector of tap weights at time (n + M)T. The algorithm is obtained 
from the (gradient) steepest-descent algorithm by replacing the gra- 
dient of %, with respect to c, by the convenient unbiased estimate, e n r n . 
The scaling of the correction term is provided by the step size A„. 

Under the assumption of tap-weight adjustments infrequent enough 
(i.e., M large enough) so that the tap-voltage vectors {r„} are mutually 
independent, eqs. (4) to (7) can be used to show that 

&n = ©opt T \C n A€ n ) » 

where /<« 

€n = C n — Copt y°) 

is the corresponding tap-weight error. In practice, it is observed that 
adjustments at the symbol rate (M = 1) result in a comparable mean- 
squared error, even though the independence of the {r n }, used in 
deriving (8), is clearly not valid. f 
If we let 

q n =(^A€n) (9) 

denote the excess mean-squared error, then it is known 2 that q x 
decreases as A» decreases, while the rate of convergence (roc) in- 
creases as A„ increases up to half the stability limit. Thus, from analog 
considerations alone, the choice of step size is important in achieving 
a balance between rate of convergence and the steady-state error. 



* It can be assumed that an initial training data sequence is known to the receiver. 
f Current work by J. E. Mazo appears to explain this anomaly. 
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Previous studies 2,5 have concentrated on rinding the best sequence 
{A„} to maximize the rate of convergence. However, the choice of the 
final A oo appropriate for the steady state has not received much 
attention, perhaps because from analog considerations alone it is clear 
that Aoo should be as small as possible consistent with a moderate 
tracking capability. Difficulties can ensue, however, in a digitally 
implemented equalizer, where too small a value of Aoo can result in an 
increased steady-state mean-squared error. 2 With this in mind, a 
reasonable compromise is to accept an W* which is somewhat larger 
than ^optl it will be shown that this implies a finite value of A*, from 
which the required tap coefficient precision can be determined. 

2.3 An iterative relation for the residual MSE 

As a compromise, the step size can be selected such that the residual 
excess mean-squared error (9) is an acceptable fraction of the minimum 
attainable steady-state error, (6); i.e., let 

q~ = y& m , (10) 

where < y < 1. With this range for y there is at most a 3-dB increase 
in the steady-state mse, due to a finite value of A. To proceed further, 
we diagonalize the channel-correlation matrix and write 

A = PAP', (11) 

where A is a (2N + 1) by (2N + 1) diagonal matrix whose entries are 
the eigenvalues, X„ of A, and P is an orthogonal matrix composed of 
the eigenvectors, p„ of A. If we denote the rotated tap-error vector by 

y* = Pe n , (12) 

then 

N 

q n = (e n A€ n ) = (y n Ay n ) m £ A,<v 2 ,), (13) 

i—N 

where y n i is the ith component of y„. 

Using the above definitions, we can investigate the dynamic behavior 
of the rotated tap-error vector, y„, by subtracting c op t from both sides 
of (7) to obtain 

€ n +M = € n — Ar„ (e^r„ + Co P tr„ — a„) 

= €„- Ar„ [e'nTn + e„(opt)] 

= [/ - Ar„r^] € n - Ar„ e„(opt), (14) 

where e„(opt) = Qj' P tr n — a n is the instantaneous error when the taps 
are at their optimum settings. From (14) we obtain 

y n+M =U- APr„r^P'] y„ - Ae n (opt) Pr n , (15) 

as the iterative equation satisfied by the rotated tap-error vector. 
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For small M, determination of the behavior of the residual mse, 
using (15), remains one of the most difficult and frustrating problems 
in data transmission. We shall avoid this problem by making the 
following assumptions: 3 

( i) The interval M (in symbol intervals) between equalizer adjust- 
ments is large enough so'that the received vectors {iwm } are mutually 
independent. 

(ii) The minimum error e„(opt) is effectively statistically indepen- 
dent of all received vectors r m . 

The support for these assumptions is the following: If the channel 
memory is less than M symbol intervals (MT seconds), then successive 
received vectors stored in the delay line will be independent, since they 
depend upon totally disjoint data symbols. Since we are concerned 
with steady-state equalizer properties, rather than convergence rate, 
infrequent adjustment does not adversely affect our results. The in- 
dependence of e„(opt) and T n +m is supported by the following obser- 
vations. First, 

<e„(opt)r„> = ([r^Copt - a n ]r„> 

= (rnVnA-^K) - x = <r„r;> A' 1 x - x = 0. (16) 

This equation expresses the well-known fact that, at the optimum tap 
setting, the error signal is uncorrelated with the current received 
sample vector. Using the assumption of independent sample vectors, 
and since <r„> = 0, it follows that <e„(opt)r„ + ^ M > - for any <?. The 
statistical independence of e„(opt) and r„ depends on their higher 
order moments as well but simulation results indicate that the steady- 
state squared error is a rather insensitive function of the received 
samples. 

To determine the steady-state step size, we use the above assump- 
tions to derive an iterative relation for q n = <y/ A y„>. We first present 
results for a synchronous equalizer and then modify those results for 
a fractionally spaced equalizer. From (13) and (15) with the rotated 
received vector, s„, defined by 

s„ = Pr„, (17) 

we have 

q n +M = y n +M A y n +M 

= ([y n (I - As n B'n) - Ae„(opt)s;] 

A [(/ - tens'n) y„ - Ae„(opt)s„]>. (18) 

To simplify (18) and to obtain a first-order linear recursion, we note 
the following: 

(Hi) By virtue of the definition of e„(opt), <e„(opt)r„> = 0, so that 

<e„(opt)s„ A (I- As„s„)y„> = 0. (19a) 
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(iv) By using the familiar eigenvalue bounds* and (i), we have 

(y' n 8 n s' n A SnSj.y,,) < Am <y^s n s^s„s^y„) 

= \ M (2N + 1) <r 2 > (y' n Ay„), (19b) 

where (r'i) is the variance of any element in the vector r„, and the 
automatic gain control is accurate enough, so that $! s» = (2N + 1) 
(r'i) is a good approximation for any data sequence. 
(v) By virtue of (ii), we have 

<e 2 (opt) a'n A s„> = W^ (r' n Ar n ) < \ M % opl (2N + 1) (r'i). (19c) 

The bounds (19b) and (19c) are relatively tight, since the bulk of the 
eigenvalues will, in practice, be comparable to Am. 

(vi) The term in (18) which contributes a negative sign, 

N 

(y'n8 n s' n A y„ ) = (yj, A 2 y n ) m J] Af (y 2 ni ), (19d) 

i=-N 

has a very significant influence on both convergence and steady-state 
behavior and must be treated more delicately. What is needed is a 
good lower bound on (19d); however, the most direct lower bound, 

(y'r>A 2 y n )>\ m (y' ri Ay n ), (20) 

which involves the minimum eigenvalue, A m , is (in general) too loose, 
since just one small eigenvalue will drastically reduce the magnitude 
of this term. 

There is, unfortunately, no tighter lower bound, since if the only 
significant component ( yii ) is associated with the smallest eigenvalue, 
as is possible when there are no restrictions on these components, then 
the bound (20) can be achieved. In practice, this is an extremely 
unlikely event (the mean-squared tap errors, ( y% ) , are pretty much 
equal in value), and (20) is unduly pessimistic in suggesting the choice 
of a steady-state step size. 

We therefore choose to approximate rather than (lower) bound 
(19d). If, as suggested above, the < yii) are relatively uniform for all i, 
then a reasonable approximation is 

<y; A 2 y„ ) a A< y' n A y„ ) = \q„ (21) 

where A is defined as either the average eigenvalue 

X = 2/vTT,J/" (22a > 



* If A is a symmetric matrix, then A„,z'z < z'Az < A.wz'z, where \„, and A.w are the 
minimum and maximum eigenvalues of A respectively, and z is any vector. 
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or the rms eigenvalue 

~ x ={wnl xf ) (22b) 

Using (19) to (22) in (18), we have the key iterative relation, 

q n+M ^ [1 - 2AA + AmA 2 (2W + l)(r 2 n )]q n 

+ \ M (2N+lHr 2 n )b 2 & op t, (23) 

for the excess mean-squared error. 

To apply the above equation to systems which use a fractionally 
spaced equalizer (fse), some of the terms appearing in (23) must be 
appropriately interpreted. In systems which use a fse, the received 
signal is sampled at the rate 1/T', where 1/T' is greater than twice the 
highest frequency component of the baseband signal. Note that if the 
time span of an fse is kept constant, the number of tap weights is in 
inverse proportion to T'. The channel correlation matrix, A, which is 
Toeplitz for a synchronous equalizer, is no longer Toeplitz for a fse. It 
is shown in the appendix that, for T = T/2 and an infinitely long fse, 
half the eigenvalues are zero and the other half tend to follow a 
uniform sampling of the aliased magnitude-squared channel charac- 
teristic. The ith eigenvector corresponding to the nonzero eigenvalues 
is given approximately as a sinusoid of frequency to, = [2i/(2N + 1)] 
(v/T), i = 0, 1, • • • , N. The eigenvectors corresponding to the zero 
eigenvalues have most of their spectral energy concentrated near 

1/T Hz. 

In the light of this information, we wish to determine if the bounds 
(19b) and (19c) are still reasonably tight for a suitably long fse. Recall 
that (19b) was obtained by using the bound 

N N 

X A,-s, ? = s' A s < A* £ si 

-N -N 

Since half the eigenvalues will be quite small, we have as a tight bound 
that 

N N/2 N/2 

£A,«?s I hsf^XM X ah 

-N N/2 N/2 

where the indices greater than N/2 will be associated with the zero 
eigenvalues. We can, however, recover the full summation by noting 
that s it a component of s = Pr, is given by the convolution of the input 
samples and the ith eigenvector. For \i\ > N/2, this convolution is 
equivalent to passing the received bandlimited signal through a nar- 
row-band filter centered at 1/T Hz, and is thus close to zero. We can 
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conclude that 

N N/2 

X Xisf < \ M j s 2 = Xms's = Aji/r'r, 

-N N/2 

and hence (19b) and (19c) remain valid. We now reconsider the 
discussion which precedes (20) and consider the term 

N N/2 

(y'* 2 y) = l,x?(yh* I *?<*?> 

-N N/2 

_ N/2 

«AZ Myt) 

N/2 

= ^M^)=A(y'Ay) =\q, (24) 

-N 

where A is an average eigenvalue over the set of significant eigenvalues 
of the channel covariance matrix. In obtaining (24), we have again 
assumed that the ( yl ) are fairly uniform (in contrast to the s 2 , which 
depend critically on the index i), and we interpret A as the average of 
the "nonzero" eigenvalues of the channel correlation matrix. 

In practice, it is not difficult to estimate A for a fse, as the 
eigenvalues, A,, tend to approach zero quite rapidly. A reasonable 
criterion is the average eigenvalue over the partial set of eigenvalues 
containing all but a small fraction (perhaps 5 percent) of the eigenvalue 
mass. With this discussion in mind, we can apply (23) to both synchro- 
nous and fractionally spaced equalizers. 

2.4 Choice of initial and steady-state step sizes 

We first investigate the conditions under which the excess mse will 
decrease with time. Now in order for the mean-squared error to decay 
it is clear from (23) that 

|l-2AA + AA/A 2 (2iV+ l)<r2)|< 1 

or 

2A 1 1 

A£/W = ^(2nTTm7I>- (25) 

Even with all the bounds and approximations which have been made 
in reaching (23), a significant difference is readily apparent in the 
maximum allowable step size for the known-gradient 2 ' 3 algorithm and 
the estimated-gradient algorithm. From Refs. 2 and 3, we know that, 
for the known-gradient algorithm to converge, it is required that 1 1 — 
A A, | < 1, or equivalently < A < 2/Xm. The fact that the maximum 
step size for the estimated-gradient algorithm is considerably smaller 
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than that for the known-gradient algorithm is deduced from (22a) and 
(25):f 

2 A 1 

Amax = 



\ M (2N+1) (r 2 ) 

= A_L< ? . (26) 

X M " . \mW+1) 
1 A, 

i-N 

Thus the maximum permissible step size for the estimated- gradient 
algorithm is reduced, by a factor on the order of the number of tap 
weights, from the maximum step size permitted in the steepest descent 
(known-gradient) algorithm. 

By differentiating the right-hand side of (23) with respect to A, we 
obtain the step size, A * , which provides the maximum rate of conver- 
gence (relative to the bound (23)): 

A* = Xg " . I (27 a ) 

n X M (2N + l)(r 2 n ) lqn+9a#Y 

Note that A£ is a function of time, n, and the generally unknown (to 
the receiver) quantities q n and g'opt. During the early stages of conver- 
gence, q n y> ^o P t, so that (27) becomes the constant value 

M- A^iK^ -i*"* <2?b> 

and q n converges exponentially towards a steady-state value. Thus a 
useful rule is: The initial step size should be half the maximum 
permissible step size. Equations (25) to (27) are similar to those 
proposed by Ungerboeck, 5 except for the channel-dependent factor, 
A/Am, appearing in our equations. This factor suggests a reduction in 
the step size for most rapid convergence with highly distorted channels. 
As convergence nears completion, the steady-state step size, A, 
resulting in a specified mean-squared error, % op t + q x , is found by 
equating the two sides of (23). Substituting the constraint, (10), into 
this relation gives 



2A 1 q„ 




" \ M ' (2N+l)(r 2 n ) ' tf. + gTopt 


y 


"' Xm' 1 + y* W+l)(rl) 


1 + y 



l MAX, 



(28) 



t We use the fact that the trace of A = (2N + l)<rj > - £-/v A,. 
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as the formula for the steady-state step size. Thus the steady-state 
step size ranges from to Vi A max as y varies from zero to unity. Ideally, 
the step size should vary between the initial value, A* = V6Amax, and 
the steady-state value, A = [y/(l + y)] A M ax < A*, in accord with 
(27a). In practice, the step size is generally changed in discrete steps 
between A* and A. 

In summary, (28) provides an approximation to the required steady- 
state step size in terms of the number of taps, the effective eigenvalue 
ratio (which depends implicitly on the number of taps), the power of 
the received samples, and the acceptable residual mean-squared error. 
Note that, as y — » 0, we require a vanishingly small step size, and that 
increasing the number of taps (to achieve the desired level of ^o P t) also 
requires a diminished A. 

III. DIGITAL CONSIDERATION 

In this section, we first review 2 the effects of digital implementation 
on the estimated-gradient tap-adjustment algorithm, and we then 
combine our analog and digital results to compute the minimum 
precision necessary to achieve acceptable performance. 

3. 1 Digital cutoff of the algorithm 

In Fig. 2 we sketch the evolution of the mean-squared error in high- 
and low-precision equalizers. In the low-precision equalizer, the steady- 
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Fig. 2 — Evolution of mean-squared error for 32-tap equalizers with tap weights of 8 
bits and 14 bits resolution. Steady-state step size = 0.00021. 
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state, mean-squared error is constrained by the impossibility of chang- 
ing a tap weight when the correction term in (7) decreases below half 
a quantization interval. Some corrections will be possible until the 
peaks of the correction terms fall below the critical level, i.e., until 

|Ae„r„|<%«, (29) 

where 5 is the interval between quantization levels, or conversely, the 
algorithm continues to adapt if 

|Ae n r n |>V 2 5 = r B a, (30) 

where B is the number of bits (including sign) used to represent the 
equalizer tap weights and (—a, a) is the range covered by the (uniform) 
quantizer. 

The above stopping condition can be approximated by replacing the 
magnitude in (30) by its peak value which is assumed to be V2 times 
its rms value, i.e., adaptation continues if 



V2A- S(eT) • /<7!)>2- B a; (31) 

where the mse which satisfies (31), with equality, will be called the 
digitally limited mse. In a passband equalizer for which (30) applies 
separately to the in-phase and quadra ture parts of the tap increment, 
the condition equivalent to (31) is AV<| e„| 2 )(| r„| 2 >/2> 2~V 

Two important consequences of (31) are: 

(i) Any attempt to make A arbitrarily small, for the purpose of 
reducing q x , will ultimately increase the steady-state mse so that (31) 
is satisfied. 

(«') The ratio of the mean-squared error of an adaptive digital 
equalizer to the mse due to quantizing the {c„} to within a lsb of their 
optimum values in a non-adaptive equalizer grows linearly with the 
number of taps and the "effective" eigenvalue ratio (see Appendices II 
and III in Ref. 2). In other words, considerably more precision is 
required for adaptation of the tap weights than for filtering the received 
signal (performing the equalizer convolution). 

Some further observations follow immediately from the above dis- 
cussions and from numerical substitutions in (31): 

( i) The number of adaptive parameters should be kept to a mini- 
mum consistent with achieving the desired steady-state mse, since an 
increase in the number of taps calls for a decreased A, which in turn 
increases the precision required [from (31)]. 

(«) The excess mse (associated with a finite step size) evaluated in 
the last section can be traded against the required precision. 

(Hi) Highly dispersive channels have a larger eigenvalue spread 
than do good channels and thus require more precision to achieve the 
same mse. However, the increased precision will be shown typically to 
be only 1 bit for channels of moderate distortion. 
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(iv) Digital word size will be restricted to a reasonable value if the 
digital equalizer is designed to allow an appropriate excess mse on the 
order of g'opt. 

3.2 Required precision 

We now presume that the steady-state step size A, determined from 
(28), is used in a digitally implemented equalizer. The analog param- 
eters are assumed such that the steady-state mse is equal to the 
digitally limited mse. Thus performance will be determined by the 
available precision. Hence the digital word length, B bits, needed in 
the tap weights to achieve g?„ can be determined by substituting (28) 
in the digital stopping condition (31): 

which reduces to the important relation 

^ v 1 1 

~ Am1 + y (22V+1) VS^' K ** } 



-'UUl . _. . , 

SNR = TT2V (34) 



where 

&out 

is the (equalized) output signal-to-noise ratio, and where 

P = ^ (35, 

is the ratio of input signal power to output (baseband) signal power.f 
Note that the equalized mean-squared error appearing in (32) can be 
written as (el) = g opt + q* = (1 + y)% opt = (1 + y) [1 - x'A _1 x], 
where the last equality follows from (6). Thus for a given (or known) 
channel, all the terms (33) can be readily computed. We now use (33) 
to estimate the required digital word length under various conditions 
typical of 9.6-kb/s data transmission.^: 

(i) Operation on a Good Channel (Fig. 3a). A good channel is one 
for which A /\ M & 1, and the number of equalizer taps can be quite 
small. In practice, however, a synchronously spaced equalizer will have 
a fixed number of taps, typically 32. With a passband equalizer 1 having 
32 complex tap pairs, the effective eigenvalue ratio is 0.93 for the 



t For the complex passband equalizer, the factor on the right-hand side of (33) is 
V2 instead of 2, and ( | r„ 1 2 > replaces (rl) in (34). 

t It should be noted that the word lengths derived in the following examples are 
considerably longer than the precision indicated from using a variance equal to a 2 = 
5 2 /12 for the quantization error in each tap weight. 
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"good" channel using a near-optimum sampling epoch. We assume 
that the maximum quantization level is a = 1, that y = x k (correspond- 
ing to a 1.1-dB degradation in output s/n ratio), and an output s/n 
ratio of 25.7 dB is observed (down 1.1 dB from that observed with 
effectively infinite resolution and vanishing step size). An agc setting 
is assumed such that p = 2. We find from (33) that Bsll bits. 

(ii) Operation on a Severely Distorted Channel (Fig. 3b). This 
severely distorted channel, which just meets the requirements of basic 
voice-grade line conditioning, has been found to have an effective 
eigenvalue ratio X/Xm (for the best sampling phase) of 0.5. Using this 
latter value and with the parameters of the previous sample, except 
for an output s/n ratio of 23.4 dB associated with the distorted channel, 
we find that B s 11.5 bits. 

(Hi) Operation with a Fractionally Spaced Equalizer on the Dis- 
torted Channel. With channel samples taken at T/2 intervals, where 
T is a symbol interval, a 64-tap equalizer is appropriate. The effective 
eigenvalue ratiof is 0.58, and we find that B » 12 bits for the same 1.1- 
dB degradation used in the above examples. 

In the next section, the precision predictions of these three examples 
are compared with simulation results. 

IV. SIMULATIONS 

The same channels for which eigenvalue ratios were derived for the 
examples of the last section were used in a simulation program for a 
qam data communication system 1 operating at 9600 bps with a baud 
of 2400/s. Only the tap weights were quantized (rounded to the nearest 
quantization level); all other variables had the IBM 370 single-precision 
resolution of roughly 24 bits. T]he magnitude of the largest real tap 
weight was about 0.5 in a full quantization range of (-1, 1). Timing 
and phase references were ideal and not subject to statistical fluctua- 
tion. The steady-state step size used in each case was computed from 
(28). The equalizer was either a 32 (complex) tap synchronous (tap 
spacing = T = symbol interval) structure, or a 64 (complex) tap T/2 
structure. 

Some simulation runs were made with a gear shifting sequence of 
adaptation step sizes 4 to reach convergence within a reasonable num- 
ber of iterations. However, great care was taken to reach the smallest 
(steady-state) step size well before complete convergence. This is 
because, with a larger step size, digital equalizer performance can 
possibly be better for a transient period than that corresponding to 
the chosen steady-state value. Deterioration of this "good" perform- 
ance, once it is achieved, depends upon large signal and/or noise 



f The "average" tap weight was the average over the 26 tap weights which collectively 
contained 95 percent of the tap-weight mass. 
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values, and may not be observed over the short duration of a simulation 



run. 



Curves A in Fig. 4, for operation with the synchronous equalizer on 
the "good" channel, indicate a degradation of about 1.5 dB for the step 
size of 0.001 calculated from (28). This is not far from the 1.1 dB 
(y = 0.5) used in that formula; however, the s/n ratio degrades another 
0.6 dB when the predicted digital word size of 11 bits is used instead 
of infinite resolution. The source of this additional degradation has not 
been investigated, but ordinary quantization noise will make a contri- 
bution, and probably also a slowed rate of adaptation, just before the 
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digital stopping condition prevails. Curve B, for operation on the 
distorted channel, is down 1.1 dB for a digital word length very close 
to the predicted 11.5 bits. 

Figure 5 illustrates a similar curve for operation on the distorted 
channel with the 64-tap T/2 equalizer, as described in example (Hi). 
The digital resolution of about 12 bits predicted from (27) for 1.1-dB 
degradation is consistent with the simulation results. Figure 6 presents 
another view of the performance of the T/2 equalizer on the distorted 
channel. This is a curve of output s/n ratio vs adaptation step size for 
the 12-bit resolution determined from (33). The step size of 0.0003 
determined from (28) and used in the experiments represented as 
points on the curve of Fig. 4, corresponds to a near-peak value of 
output s/n ratio. This again supports the analysis of Section III as 
providing a useful formula for deciding on the steady-state step size to 
be used in a digitally implemented equalizer. 

V. DISCUSSION AND CONCLUSIONS 

We have proposed a criterion for determining the number of bits 
needed to represent the tap weights in a digitally implemented equal- 
izer. For a given steady-state adaptation step size, with its attendant 
increase in steady-state mean-squared error, this criterion is that the 
word size used be just large enough to "match" this increase without 
further degrading performance. The word length is a function of the 
output s/n ratio (the ratio of output signal power to steady-state mean- 
squared error), the fractional increase in the mean-squared error over 
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Fig. 5 — Output s/n ratio vs digital word length (of equalizer tap weights) for a 64 
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= 0.0003 determined from (28). 
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that of an ideal infinite-resolution receiver, the number of taps, and 
the effective eigenvalue ratio of the channel-covariance matrix. 

For data transmission at 9.6 kb/s, it can be concluded, on the basis 
of the representative voice-grade channels simulated in this study and 
neglecting the effects of limited tap-weight resolution on timing recov- 
ery and carrier phase tracking as well as the (relatively minor) degra- 
dations resulting from limiting the resolution of variables other than 
the tap weights, that a digital word length of 12 bits is adequate to 
represent the tap weights for updating purposes in a 32-tap synchro- 
nous equalizer or a 64-tap T/2 equalizer. 

APPENDIX 

Asymptotic Eigenvalue Distribution for the Correlation Matrix of 
Synchronous and Fractionally Spaced Equalizers 

In this appendix, we describe the eigenvalues of the correlation 
matrix for infinitely long synchronous and fractionally spaced equal- 
izers. 

A. 1 Synchronous equalizer 

From the definition A = (r„r'„>, we note that A is a Toeplitz matrix, 
and that the eigenvalue equation is given by 



£ A k -, P/ = \pk -N<k<N, 



(36) 
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where A k -e is the kfth element of A, X is an eigenvalue, and p' = 
(P-n, • • • ,Po, • • • ,Pn) is the associated eigenvector. As N— > oo, taking 
the Fourier transform of both sides of (36) yields 



where 
A(u) = 



p(-4 



<«)-AP(u), H<^, 




(37) 


2 






+ a 2 = |X eq (co)| 2 +a 2 , 








i i * 
\»\*f- 


(38)f 



For very large N, the discrete asymptotic approximation to (37) is 

AMPM-XPM, Ui = <2N+l)T ' " iV - I - Ar - < 39a > 

Unless A(ui) has the same value for two or more values of the index 
i, the only way (39a) can be satisfied is for P(w) to be concentrated at 
a single frequency, i.e., be a sinusoid. Repeated values of A («,•) corre- 
spond to repeated eigenvalues and an eigenvector subspace which can 
be spanned either by distinct sinusoids or by combinations of sinusoids. 
Then the solution to (37) is 

\i = A(ai) 

Pi(u) = 5(<o - to,) ± 8(u + at) (39b) 

Thus for a synchronous equalizer, the asymptotic (N— > oo) eigenvalues 
uniformly sample the folded-channel-plus-noise spectrum, and the 
eigenvectors are the corresponding sinusoids. 

A. 2 Fractionally spaced equalizers 

Here the channel-correlation matrix while symmetric is not Toeplitz; 
thus Fourier transform techniques do not yield the eigenvalues and 
eigenvectors in the above short order. For convenience, we consider 
the noiseless situation, and the eigenvalue equation is 

N 

X A(kT',ST')p(ST')=\p(kr) -N<k<N, (40) 

f — N 



t The Nyquist-equivalent spectrum, X e<l (<o), is defined as X*,(w) = J] X[u + k(2rr/T'\, 

* 
where the receiver sampling phase is incorporated into X(w). 
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where the A/th element of A is given by 

A(kT',ST') =%x(mT- kT')x(mT -ST). (41) 

m 

With T - T/2, we write (40) for even and odd values of k, 

jl'(4'D>('D*,5X>!-'-9'('D 

\/\sN \f\sN 

-W*|j. *even (42) 

|/|sJV If'IsTV 

■Ap(*D» * odd " (43) 

Now (42) and (43) can be written as 

N/2 N/2 / T\ / T\ 

I A(kT,ST)p(ST) + I A[kT,ST + -)p[ST + -) 

e N/2 f N/2 \ &/ \ A J 

= Xp(kT), -N/2 <k<N/2 (44) 

N/2 I T \ N/2 

I A[kT + -,ST)p(ST)+ S 

/■—N/2 \ * ) f—N/2 

•A(kT + Z t ST + ^p(sT + ^-\p(kT + ^, (45) 

respectively, where both equations hold for N integer values of k, and 
more importantly the various component matrices are now all Toe- 
plitz.f If we consider the situation where X(co) has less than 100 
percent excess bandwidth, 8 then it is useful to introduce the four 
spectra 



*«,(«) A X(u) + X[ co - — ) +X\u+ — 



2tA I 2m 

T) +X [ a+ T 



2m\ __/ 2tt 



V ,<■ ) A A '( ,;» - X[ u --j -X\» + — j, |co| <- (46) 

2tA I 2m 



7T 



P«,(w) A P(u) + P[ co - — I + PI co + 



t For example, A(kT, fT + (T/2)) = 5>, x(mT - kT)x(mT - fT + (T/2)) =T„ 
x(nT)x(nT+ (k-f)T+ (T/2)). 
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2tt 



Pec(co) A P(co) - P co - — - P co + — , 



277 



•l*f 



(47) 



where we note that the discrete Fourier transform of the eigenvector 
p(^(T/2)),P(co),isgivenby 

P(o>)4 £ p(/£\e 7 

f — N 



= P eq (co,) + e"^™Pe<M)> <9 = f^) feY -JV ssy < N. 



(48) 



Taking the synchronous Fourier transform (i.e., with respect to the T- 
sec sampling interval) of (44) and (45) gives as an approximation (exact 

as N —* oo) 

| X eq (Uj ) | 2 P eq (CO, ) + X eq (Uj ) ^ (U3j )P eq (Wj ) = AP eq (cO, ) 



-=(|)fe)' -V/*<y< N/2. 



(49) 



Xe q (c0 7 )X* q (cOy)Pe q (cOy) + | X eq (cO, ) | 2 P eq (c0 7 ) = AP eq (cO, ). 

Note that p(kT + (T/2)) has the discrete Fourier transform exp 
(—ju>j(T/2) P e q(co/)), where the synchronous transform of p(kT) is 
P eq (uj). Arguing as we did for the synchronous equalizer, we see that 
the ith eigenvectors P,(co>) and P,(co/) must again be delta functions at 
co, = (2i/N)(ir/T). Consequently, the eigenvalues, A,, must satisfy 

A 2 - A,[ | X q (co,) | 2 + | £,(«,) | 2 ] = 0, 

and thus the eigenvalues are 

A} 11 = 



(50) 



A} 2> = |Xe q (cO,)| 2 + |^ q (cO,)| 2 =S 



klir 

N 



N 



-2 S '*2- (51) 

In contrast to (38), which applies to the synchronous equalizer, half 
the eigenvalues are exactly zero, while the other half are samples of 
the aliased magnitude-squared channel transfer function. Not surpris- 
ingly, the eigenvalues are independent of both the channel phase 
characteristics and the receiver sampling phase, and if | X(co) | 2 is 
Nyquist, then all the eigenvalues are unity. Since the eigenvalues are 
determined, we can now solve for the eigenvectors. Since p {fT) has 
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the transform Peq(co) and p{ST + (T/2)) has the transform 
P eq (co) e~ MT/2) , the eigenvectors associated with the zero eigenvalue 
are constructed as 

T\ [X^Me j ^ {T/2 \ neven ™ 

n ^)-\-X^ l )e j ^ T,2 \ note, ( °-' 

while the eigenvector associated with the nonzero eigenvalue is 

T\ lX eq ( Ui )e Ju - nlT/2) , /I even (53) 



n ^)~\X e(i Me j ^ lT/2 \ nodd. 

At this point, we remark that when on is not in the rolloff region, 
then X eq {o3j) = X eq (o>i), and (53) describes a sinusoid of frequency <o„ 
since the even and odd portions of p,(n(T/2)) mesh together in a 
continuous manner (i.e.,p,(n(T/2)) = X eq Me ju - n(T,2) ). However, (52) 
describes a function which changes sign and oscillates almost a full 
cycle in T seconds. Consequently, pdn{T/2)), as given by (52), will 
have most of its spectral energy concentrated near 1/T Hz. When to, is 
in the rolloff region, the frequency content of (52) and (53) will differ 
somewhat from the above extreme cases, but the general results will 
still be as above. Numerical evaluations have confirmed the above. 

This completes our discussion concerning the nature of the eigen- 
values and eigenvectors for a fractionally spaced equalizer. 
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